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Florida's Senate Bill 1720 allowed many students to bypass developmental education and enroll directly in introductory 


college-level courses. We use an interrupted time series design to introductory college-level courses enrollment and 


passing rates in English and math for three cohorts of college students prereform and three cohorts postreform. Based on a 


cohort-by-cohort comparative analysis, we find that cohorts after the reform are more likely to enroll and pass introductory 


college-level courses in their 1st year of college, indicating that the reform may help to accelerate student success in 


college. Further, we find that Black and Hispanic students experience even greater gains in passing rates than White 


students, effectively narrowing the racial/ethnic achievement gap. 
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tudents who arrive at college underprepared have histori- 
S cally faced an “obstacle course” of developmental educa- 
tion (DE) requirements upon college enrollment, which 
many never even begin or complete (Baily et al., 2010). Students 
are required to pay for these courses but do not receive any col- 
lege credit. They also must complete these DE courses before 
enrolling in the gateway courses that fulfill degree requirements, 
thus slowing their academic momentum. In response to these 
challenges, many states and institutions have begun implement- 
ing a variety of different policies to reform their DE programs 
(e.g., Edgecombe, 2011). In this article, we look at policy 
impacts from the state of Florida, which implemented an exten- 
sive statewide reform that made DE optional for the majority of 
incoming students at the 28 state colleges in the Florida College 
System (FCS, the former community college system), and also 
required the colleges to change the instructional modalities for 
remaining DE courses to allow students to progress more quickly 
into college credit courses. Colleges were also required to develop 
a plan for providing enhanced advising and support services for 
students. 
We begin by providing a brief overview of DE and recent reform 
measures across the country. Then, we detail the components of 
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Florida’s DE reform efforts and the theory of action underlying 
how these efforts may improve students’ acceleration through 
introductory college-level courses (often termed gateway 
courses). Next, we describe our methods, which use an inter- 
rupted time series design to examine whether student success in 
introductory college-level courses during the Ist year of college 
has changed since the reform, and a comparative interrupted 
time series to study differential changes by race/ethnicity. After 
presenting our results, we offer a general conclusion regarding 
student success in introductory college-level courses following 
major DE reform in Florida. 


Related Literature and Context 


Historically, prior to enrolling in introductory college-level 
courses, many students across the country were first required to 
take DE courses in reading, writing, and/or math. Indeed, esti- 
mates suggest that over half of students enrolled in an associate 
degree program were required to take at least one developmental 
course (Bailey et al., 2010; Complete College America, 2012). 
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In Florida alone, historical estimates indicate that up to 70% of 
first-time-in-college (FTIC) community college students were 
enrolled in at least one DE course (Underhill, 2013). And addi- 
tional studies have shown that Black and Hispanic students tend 
to be enrolled in developmental courses at higher rates than 
White students (Attewell et al., 2006; Perry et al., 2010; Ross 
et al., 2012). Unfortunately, very few students enrolled in devel- 
opmental courses ever attempt, let alone pass, an introductory 
college-level course (Bailey et al., 2010; Complete College 
America, 2012). Thus, for many students, DE courses were 
often the main obstacle in achieving the academic momentum 
necessary to be successful in postsecondary education. Still, 
some studies have shown that DE may benefit some students, 
particularly those scoring the lowest on traditional college place- 
ment tests (Boatman & Long, 2018). 

In order to better serve all students, many states have turned 
to reform measures that alter the placement and/or instruction 
of DE, with the goal of accelerating students into introductory 
college-level courses (Rutschow & Meyer, 2018). Reform mea- 
sures in other states have focused on policies that accelerate stu- 
dents through DE and/or limit students’ time in DE. Thus, the 
goal of DE reform is often to ensure student success in the intro- 
ductory college-level courses, regardless of prior academic prepa- 
ration. The theory of action underlying Florida’s Senate Bill (SB) 
1720 is that the reform efforts will increase student success in 
college by changing state policy directives, institutional pro- 
grams and practices, and student decision-making, 

Prior to Florida’s DE reform, approximately 70% of FTIC 
students scored below college-ready on a statewide placement 
test and were required to take at least one DE course (Underhill, 
2013). Under SB 1720, college students were exempt from col- 
lege placement testing and developmental coursework if they 
entered a Florida public high school in 2003-2004 or later and 
went on to graduate with a standard high school diploma, or if 
they were active-duty members of the military. These students 
were assumed to be college-ready and could enroll directly into 
gateway courses in math and English. Prior research has shown 
that nearly one quarter of college students are misplaced into 
their first college course when placement decisions are based on 
test scores alone, most of these students being unnecessarily 
placed into DE courses (Scott-Clayton et al., 2014). Thus, mak- 
ing DE optional may reduce the financial and opportunity costs 
to students of being placed into courses they may not need, and 
may improve their academic progression. 

The second component of the reform required colleges to 
change the way that DE courses are offered by implementing 
compressed, contextualized, modularized, or corequisite modali- 
ties. Compressed courses meet more frequently over fewer weeks, 
which potentially allows students to complete two sequential 
courses in the same semester. There is some evidence that com- 
pressed courses are associated with positive effects on short-term 
outcomes such as gateway course completion, as well as longer- 
term outcomes like credit accumulation and degree completion 
(Hodara & Jaggars, 2014). Contextualized courses present reme- 
dial material in an applied manner related to the student's 
intended major. Although there is limited rigorous research on 
this modality, there is some evidence that these courses may 
improve students’ course performance by making the material 


more relevant to students’ interests and career goals (Perin, 
2011). Modularized courses assess mastery of course standards 
and then allow students to complete customized modules for 
only the standards in which they did not demonstrate mastery. 
This often results in students completing fewer credits in DE 
courses than they would otherwise need (Kalamkarian et al., 
2015), and experimental evidence suggests that students are just 
as successful in modularized courses as more traditional DE 
models (Weiss & Headlam, 2019). Lastly, corequisite courses 
allow students to take developmental and college-level courses 
concurrently. This approach has been shown to increase the per- 
centage of students completing college-level courses in the first 
semester or Ist year of college in other states (Denley, 2015; 
Jones, 2015; Kalamakrian et al., 2015). 

We note that some of the colleges had been experimenting/ 
piloting the use of some of these instructional strategies in the 
years leading up to the reform (Park et al., 2016). As such, our 
identification strategy, which we discuss in the next section, 
accounts for any underlying upward trends that may be present 
in student outcomes prior to the reform that could be due to 
early implementation of this component of the reform. 

The third component of the reform required colleges to pro- 
vide enhanced advising services to increase student awareness of 
the developmental course options, as well as additional support 
services like tutoring for underprepared students. College stu- 
dents who receive enhanced advising tend to take and pass more 
courses (Scrivener & Weiss, 2009), and are also more likely to 
take advantage of tutoring and other types of academic support 
services (Visher et al., 2010). Support services typically tend to 
be underutilized by college students, even though they increase 
the likelihood that students will persist in college courses and 
tend to improve students’ college GPAs (Perin, 2004). 

Specific to Florida and from a broad, overall policy impact 
perspective, our earlier work has shown some initial promising 
results from Florida’s DE reform. In the Ist year after SB 1720, 
the predicted probability of both taking and passing gateway 
courses increased by 5.3 percentage points in English and 3.7 
percentage points in mathematics relative to the year prior to the 
reform. Further, our own work has shown that passing rates 
increase at a more rapid rate for Black and Hispanic students, 
compared to White students (Park et al., 2018). However, our 
work to date has been limited to one cohort of student outcomes 
following the reform. What is not yet known is whether these 
trends continue in the multiple years following the implementa- 
tion of the reform. In other words, although the DE reform pro- 
duced positive results for one cohort of students, did this 
continue to be the case for additional cohorts? 

In this article, we employ a more rigorous approach and addi- 
tional years by comparing three cohorts of students before and 
three cohorts of students after the reform. The balanced panel of 3 
years of data prior to the reform and 3 years of data after the 
reform allows us to examine whether the reform has had an impact 
on student success for multiple cohorts of students following its 
implementation. Specifically, we examine enrollment rates as well 
as passing rates in two different ways: course-based passing rates 
and cohort-based passing rates. Whereas course-based._ passing 
rates are a more traditional notion of passing rates (the number of 
students passing the course expressed as a share of the number of 
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students enrolled in the course), cohort-based passing rates (the 
number of students passing the course expressed as a share of the 
total number of students in a cohort of incoming students) pro- 
vide a more global view of policy impacts. Specifically, cohort- 
based passing rates are a measure of the total impact of the policy 
and its ability to successfully increase student success. According 
to a recent study by Belfield et al. (2019), 1st-year measures of 
gateway course enrollment and completion rates are key predic- 
tors of longer-term student success and may be particularly impor- 
tant for explaining racial equity gaps in college completion rates. 
The following research questions guided this study: 


(1) How have enrollment rates, course-based passing rates, 
and cohort-based passing rates in introductory college- 
level courses changed following the DE reform among 
FTIC students enrolled in the FCS institutions? 

(2) How did the change differ for students of different racial/ 


ethnic backgrounds? 


Research Design 
Data 


We use data from Florida’s K-20 Education Data Warehouse 
(EDW), which tracks all Florida public school students remain- 
ing in-state from kindergarten to postsecondary education. For 
these analyses, we use data from college enrollment records, stu- 
dent background characteristics, and indicators of high school 
preparation. We include data from all 28 FCS institutions in 
Florida. We include six cohorts of FTIC students, three cohorts 
who were enrolled prior to SB 1720 (entering cohorts Fall 
2011—Fall 2013), and three cohorts who were enrolled after 
(entering cohorts Fall 2014—Fall 2016). 

For enrollment rates in college-level courses, we calculated 
the percentage of students enrolled in these courses, disaggre- 
gated by subject, as the share of the cohort of FTIC students 
who began their studies in FCS institutions in a given fall term. 
Then, for introductory college-level course passing rates, we 
used two different measures. The first is a course-based passing 
rate, calculated as the percentage of students passing the course 
as the share of the total number of students enrolled in the 
course, disaggregated by subject. The second measure is the 
cohort-based passing rate, which is calculated as the percentage 
of students passing the course as the share of the total number of 
students in the entire cohort. Thus, the cohort-based_ passing 
rate captures the overall effect of the policy and ascertains 
whether more students have been successful at taking and pass- 
ing introductory college-level courses from the perspective of a 
cohort-by-cohort comparison. In addition, we also have mea- 
sures of high school academic preparation, gender, race/ethnic- 
ity, and free/reduced-lunch eligibility. Descriptive statistics, by 
cohort, are presented in Table 1. 


Analytic Approach 


We use a time series design to examine whether there have been 
any changes in students’ enrollment and completion of intro- 
ductory college-level courses before and after the reform. We use 
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a balanced panel with 3 years of data prior to the reform and 3 
years after the reform. We assess the likelihood of enrolling in 
and passing college-level courses in the 1st year of college. In 
English, the first introductory college-level course is English 
Composition 1 (ENC1101). In math, we examine results sepa- 
rately for Intermediate Algebra (MAT 1033), which counts for 
elective credit only, and gateway math courses that fulfill the 
transfer associate’s degree requirements in math (College Algebra, 
MAC1105; Liberal Arts Math 1, MGF1106; Liberal Arts Math 
2, MGF1107; and Introductory Statistics, STA2023). For this 
first analysis, we use all of the students in each cohort as our full 
sample. 

To empirically investigate the overall impact of the reform on 
enrollment and passing rates, we estimate the model below for 
student 7 at college j in year (cohort) & 


logit(y x) = By + By (2014), + B,(S),, + Bs (HS), +; + Ay. 


In this specification, B, captures the change in the course enroll- 
ment/passing rate in the postreform period, B, is a vector of stu- 
dent background characteristics, B, is a vector of high school 
academic preparation indicators, €, is a college fixed effect to 
account for unobserved heterogeneity across institutions, and A, 
is a continuous year (cohort) indicator to account for any under- 
lying temporal trends.' By including the time trend, we are able 
to net out any impacts that may have resulted from changes 
other the 2014 implementation of the DE reform (such as early 
adoption of the new instructional modalities by some of the col- 
leges) that could have impacted student outcomes (Jacob et al., 
2017). In other words, by including a continuous year indicator, 
B, will only capture an increase in student outcomes that can be 
attributed directly to the policy and not to any prepolicy trend 
that could have continued after the policy was implemented. 
However, one limitation of this approach is that there could be 
other unobserved changes in the postpolicy years that may have 
affected the outcomes, even in the absence of the policy. 

Further, in order to explore whether there were differential 
changes in enrollment/passing rates by race/ethnicity, in an addi- 
tional set of analyses, we include indicators for Hispanic and 
Black students (White students form the comparison group; stu- 
dents of other race/ethnicity are excluded from these models) 
and interact these indicators with the postreform indicator. 

We estimate the following model for student # at college 7 in 
year (cohort) t: 


logit( yi.) = Bo + Bi (204) + Bp (Black), + Bs (Hispanic), 
+ By(2014* Black)... + Bs (2014* Hispanic). 
+ Be (S),,+ By (HS). + 6; + Ar 


Under this specification, B, captures the change in course enroll- 
ment/passing rate in the postreform period; B, and B, capture 
the overall difference in outcomes for Black and Hispanic stu- 
dents, respectively; 8, and 8, capture any differential changes in 
student outcomes for Black and Hispanic students, respectively, 


Table 1 
Cohort Total Breakdown by Student Background 


Prepolicy Postpolicy 
2011 2012 2013 2014 2015 2016 
By race/ethnicity (students of other racial/ethnic background not reported here) 
White 29,757 27,069 27,124 26,261 25,673 23,522 
41.03% 41.75% 39.63% 38.44% 38.19% 34.92% 
Black 16,180 13,432 14,809 14,065 13,391 12,998 
22.31% 20.72% 21.64% 20.59% 19.92% 19.30% 
Hispanic 22,241 20,333 22,197 23,514 23,516 24,556 
30.67% 31.36% 32.43% 34.42% 34.98% 36.45% 
By gender 
Male 34,396 30,947 32,894 32,374 32,123 32,212 
47.43% 47.73% 48.06% 47.39% 47.78% 47.82% 
Female 38,131 33,891 35,546 35,941 35,109 35,152 
52.57% 52.27% 51.94% 52.61% 52.22% 52.18% 
By free/reduced-lunch (FRL) status 
FRL-eligible 22,392 20,641 25,385 27,128 27,973 27,945 
30.87% 31.83% 37.09% 39.71% 41.61% 41.48% 
Not FRL-eligible 50,135 44,197 43,055 41,187 39,259 39,419 
69.13% 68.17% 62.91% 60.29% 58.39% 58.52% 
Total 72,527 64,838 68,440 68,315 67,232 67,364 


postreform; B, is a vector of student background characteristics; 
B, is a vector of high school academic preparation indicators; ¢, 
is a college fixed effect to account for unobserved heterogeneity 
across institutions; and A, is a continuous year (cohort) indicator 
to account for any underlying temporal trends. This model cap- 
tures the base changes in overall student outcomes between the 
prereform period and the postreform period, as well as whether 
there has been a differential change for Hispanic and Black stu- 
dents. In this second analysis, we only include White, Black, and 
Hispanic students. 

Before presenting our findings, we note that although it is 
tempting (as well as potentially quite interesting) to investigate 
the impacts of individual components of Florida’s DE reform, 
we also see perhaps greater merit in examining the impacts of the 
policy as a whole. We also note that previous attempts at isolat- 
ing impacts of components of DE reform have concluded that is 
difficult to disentangle these effects when states implement DE 
reform policies that contain several elements, such as those in 
North Carolina, Virginia, and Florida (Bickerstaff et al., 2016). 
Thus, we remind the reader that our results should be inter- 
preted as overall policy effects for incoming cohorts of FTIC 
students in the FCS, including both exempt and nonexempt stu- 
dents. In addition, we note that the overall effect of the reform 
may be greater than the sum of its parts, further warranting a 
holistic analysis. Put differently, there may be a form of synergy 
that emerges from the three major components of the reform 
that adds to the impact in a way that is greater than the indi- 
vidual impacts of the three components added together. More to 
that point, our most recent findings from an annual survey to 
campus leaders across the FCS found that the DE reform 
brought about institutional transformation that extended far 


beyond the requirements of SB 1720 (Mokher, Spencer, et al., 
2020). These findings suggest that Florida’ DE reform brought 
about comprehensive reform that has created an increased cul- 
ture of student success. As such, we are interested in whether the 
reform had impacts for all incoming FTIC students as well as 
whether these impacts varied by race/ethnicity. 


Findings 
Descriptive Portrait 


We begin with descriptive portrait highlighting enrollment and 
passing rates for introductory college-level courses. We present 
findings for all students, disaggregated by subject. Additional 
findings, disaggregated by race, can be found as an online sup- 
plement to this article at centerforpostsecondarysuccess.org. 


Enrollment rates. As shown in Table 2, Ist-year introductory 
college-level course enrollment rates increased following the 
implementation of the DE reform. Immediately after implemen- 
tation, introductory college-course enrollment rates increased by 
6.49, 8.69, and 3.20 percentage points for English composition, 
intermediate algebra, and our pooled measure of gateway math 
courses, respectively. We note that we are modeling intermediate 
algebra and gateway math courses as different outcome measures 
due to the fact that some students, depending on their intended 
major, may be required to take intermediate algebra (a college- 
credit bearing course) as a prerequisite course prior to enrolling in 
a gateway math courses that will satisfy the math requirement for 
the associate’s degree. Further, this increase continued into the 
2015 cohort before experiencing a slight plateau in the 2016 
cohort. 
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Table 2 
First-Year Introductory College-Level Course Enrollment Rates, All Students 


Prepolicy Postpolicy 
2011 2012 2013 2014 2015 2016 
English composition 
Enrollment rate 56.14% 60.78% 63.64% 70.13% 73.04% 72.40% 
Students enrolled 40,718 39,411 43,552 47,910 49,105 48,772 
Number in cohort 72,527 64,838 68,440 68,315 67,232 67,364 
Intermediate algebra 
Enrollment rate 26.50% 28.23% 33.19% 41.88% 45.28% 43.36% 
Students enrolled 19,219 18,306 22,712 28,613 30,446 29,208 
Number in cohort 72,527 64,838 68,440 68,315 67,232 67,364 
Gateway math courses 
Enrollment rate 21.75% 22.93% 24.84% 28.04% 33.48% 33.66% 
Students enrolled 15,772 14,866 17,000 19,153 22,508 22,672 
Number in cohort 72,527 64,838 68,440 68,315 67,232 67,364 
Table 3 
First-Year Course-Based Passing Rates in Introductory College-Level Courses, All Students 
Prepolicy Postpolicy 
2011 2012 2013 2014 2015 2016 
English Composition 
Success rate 74.81% 75.26% 75.28% 74.51% 75.09% 74.41% 
Number of successes 30,460 29,662 32,786 35,699 36,873 36,289 
Number of students 40,718 39,411 43,552 47,910 49,105 48,772 
Intermediate algebra 
Success rate 65.28% 65.59% 62.65% 57.85% 60.29% 60.07% 
Number of successes 12,547 12,006 14,229 16,554 18,357 17,545 
Number of students 19,219 18,306 22,712 28,613 30,446 29,208 
Gateway math courses 
Success rate 68.50% 68.80% 67.24% 65.93% 66.40% 66.96% 
Number of successes 10,804 10,228 11,431 12,615 14,839 15,055 
Number of students 15,772 14,866 17,000 19,153 22,508 22,672 


Course-based passing rates. As shown in Table 3, the Ist-year 
course-based passing rate for English composition remained rel- 
atively constant over time, although the number of students 
entering the course increased dramatically following the imple- 
mentation of SB 1720. The course-based passing rate for inter- 
mediate algebra decreased by nearly 5 percentage points in 2014 
but rebounded somewhat in the 2015 and 2016 cohorts. Just as 
with English, though, the number of students enrolling in inter- 
mediate algebra increased dramatically in the postimplementa- 
tion cohorts. Course-based passing rates in gateway math courses 
declined slightly following the implementation of SB 1720. 


Cohort-based passing rates. As shown in Table 4, the number of 
students both taking and passing introductory college-level Eng- 
lish and math courses in their 1st year increased following the 
reform. Cohort-based passing rates in both English composition 
and intermediate algebra saw immediate high jumps in the Ist 
year postreform, increasing by 4.36 and 3.44 percentage points, 


660 | EDUCATIONAL RESEARCHER 


respectively. College-level math courses had a moderate passing 
rate increase of 1.77 percentage points in the Ist year postre- 
form, but they experienced a higher increase in the 2nd year 
postreform, with a jump by 5.37 percentage points from 2013. 
All courses reached a plateau in the 3rd year postreform. 


Regression-Adjusted Results 


We move now to our regression-adjusted results under our inter- 
rupted time series/comparative interrupted time series designs. 
For ease of interpretation, we report our findings as predicted 
probabilities and marginal effects, calculated from the regression 
results. Full regression results are available from the authors. 


Enrollment rates. All of the increases in the 1st-year introductory 
college-level course enrollment rates following the implementa- 
tion of the DE reform were statistically significant. English 
enrollment rates increased by 4.79 percentage points, while 


Table 4 
First-Year Cohort-Based Passing Rates in Introductory College-Level Courses, All Students 


Prepolicy Postpolicy 
2011 2012 2013 2014 2015 2016 
English composition 
Success rate 42.00% 45.75% 47.90% 52.26% 54.84% 53.87% 
Number of successes 30,460 29,662 32,786 35,699 36,873 36,289 
Number of students 72,527 64,838 68,440 68,315 67,232 67,364 
Intermediate algebra 
Success rate 17.30% 18.52% 20.79% 24.23% 27.30% 26.05% 
Number of successes 12,547 12,006 14,229 16,554 18,357 17,545 
Number of students 72,527 64,838 68,440 68,315 67,232 67,364 
Gateway math courses 
Success rate 14.90% 15.77% 16.70% 18.47% 22.07% 22.35% 
Number of successes 10,804 10,228 11,431 12,615 14,839 15,055 
Number of students 72,527 64,838 68,440 68,315 67,232 67,364 
Table 5 


First-Year Predicted Probabilities of Introductory College-Level Course Enrollment Rates Before/After 
Florida’s DE Reform 


Pred. Prob. Prereform Pred. Prob. Postreform Difference 
English 
ENC1101 65.44% 70.23% 4.79°** 
Math 
MAT1033 31.02% 39.21% 8.19*** 
Gateway math 22.78% 27.67% 4.89*** 


Note. Significance reported for differences prereform/postreform. 
0 < 001. 


intermediate algebra and gateway math courses increased by 
8.19 and 4.89 percentage points, respectively (Table 5). 

Further, all of the differential effects by race/ethnicity were 
also statistically significant and positive (Table 6). Not only did 
all students enroll in introductory college-level courses at higher 
rates following the implementation of the reform, but Hispanic 
and Black students increased their enrollment at faster rates than 
White students, narrowing the enrollment gap for Black and 
White students and effectively closing the enrollment gap for 
Hispanic and White students. In English composition, for 
instance, while White students experienced an increase of 7.47 
percent points in their enrollment rate, Hispanic and Black stu- 
dents experienced 12.75 and 22.64 percentage point gains, 
respectively. A similar pattern also occurred in intermediate alge- 
bra and gateway math courses. 


Course-based passing rates. Table 7 presents the results from our 
set of models predicting overall 1st-year course-based._ passing 
rates in introductory college-level courses before and after the 
implementation of Floridas DE reform. Overall, course-based 
passing rates in English composition (ENC1101) and gateway 
math course passing rates (MAC1105, MGF1106, MGF1107, 
and STA2023) remained the same following the reform. In 


intermediate algebra, however, course-based passing rates declined 
by nearly 5 percentage points. 

Table 8 presents the results from our set of models predicting 
differential course-based passing rates by race/ethnicity. In 
English composition, White and Hispanic students experienced 
a slight increase in course-based passing rates (1.25 and 0.54 
percentage points, respectively), and Black students experienced 
a decline (0.67 percentage points). Further, in intermediate alge- 
bra, whereas all students experienced a decline, both Hispanic 
and White students had similar (non-statistically significant 
from each other) declines of around 4 percentage points, and 
Black students had declines of 6.07 percentage points, roughly 2 
percentage points more than White and Hispanic students. 
Finally, White and Hispanic students experienced no significant 
change in course-based gateway math courses, and Black stu- 
dents experienced 4.3 percentage point decline in course-based 
passing rates. 

Table 9 presents regression-adjusted 1st-year cohort-based 
passing rates before and after the implementation of Florida’s DE 
reform. Overall, we find that all three indicators for cohort-based 
passing rates increased significantly following the reform. 
Specifically, cohort based-basing rates increased by 3.38, 3.48, 
and 2.94 percentage points in English composition, intermediate 
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Table 6 


Predicted Probabilities and Marginal Effects for First-Year Introductory College-Level Course Enrollment 
Rates, by Race/Ethnicity 


English Composition 


2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 49.47% 72.11% 22.64*** 
Hispanic 61.70% 74.45% 12.75*** 
White 67.18% 74.65% 7.47" 
Marginal effects 
Black vs. White 15.17" 
Hispanic vs. White 5.28*** 
Intermediate Algebra 
2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 24.09% 44.51% 20.42*** 
Hispanic 31.04% 45.76% 14.72*** 
White 28.66% 39.32% 10.66*** 
Marginal effects 
Black vs. White 9.76*** 
Hispanic vs. White 4.06*** 
Gateway Math 
2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 11.86% 22.10% 10.24*** 
Hispanic 21.92% 31.97% 10.05*** 
White 24.60% 32.70% 8.10*** 
Marginal effects 
Black vs. White 2.14*** 
Hispanic vs. White 1.95*** 


Note. Significance reported for differences prereform/postreform. 
**9 < 001. 


Table 7 


Predicted Probabilities for Course-Based Passing Rates for 1st-Year Introductory College-Level Courses 
Before/After Florida’s DE Reform 


Pred. Prob. Prereform Pred. Prob. Postreform Difference 
English 
ENC1101 75.92% 76.09% 0.17 
Math 
MAT1033 64.17% 59.42% —4,75*** 
Gateway Math 67.87% 68.32% 0.45 


Note. Significance reported for differences prereform/postreform. 
**9 < 001. 


algebra, and combined gateway math courses, respectively. Of Table 10 presents the results from our set of models predict- 
note is that following the reform, over half of the incoming ing differential cohort-based passing rates by race/ethnicity. 
cohorts were successfully taking and passing gateway English Across the three panels, students of all racial/ethnic backgrounds 


courses within the Ist year, with nearly one in five students tak- experienced increased cohort-based passing rates in their English 


ing and passing gateway math courses. 


662 | EDUCATIONAL RESEARCHER 


and math courses, with Black and Hispanic students seeing even 


Table 8 
Predicted Probabilities and Marginal Effects for Course-Based 1st-Year Passing Rates for Introductory 
College-Level Courses, by Race/Ethnicity 


English Composition 


2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 69.32% 68.57% -0.67*** 
Hispanic 77.50% 78.19% 0.54*** 
White 76.31% 77.60% 1.25" 
Marginal effects 
Black vs. White -1.92*** 
Hispanic vs. White -0.71 
Intermediate Algebra 
2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 56.08% 50.01% -6.07*** 
Hispanic 65.39% 60.91% —4.48*** 
White 64.13% 60.43% -3.70"** 
Marginal effects 
Black vs. White -2.37* 
Hispanic vs. White -0.78 
Gateway Math 
2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 61.37% 57.07% —4.30** 
Hispanic 69.09% 68.95% -0.14 
White 69.47% 68.97% —0.53 
Marginal effects 
Black vs. White 4.16" 
Hispanic vs. White 0.39 


Note. Significance reported for differences prereform/postreform. 
*90<.05. **p < .01. ***p < .001. 


Table 9 
Predicted Probabilities for Cohort-Based Passing Rates for 1st-Year Introductory College-Level Courses 
Before/After Florida’s DE Reform 


Pred. Prob. Prereform Pred. Prob. Postreform Difference 
English 
ENC1101 47.85% 51.23% 3.38°** 
Math 
MAT1033 19.71% 23.19% 3.48*** 
Gateway math 14.53% 17.47% 2.94*** 


Note. Significance reported for differences prereform/postreform. 
*™* < 001. 


greater increases than White students. For instance, Black stu- 
dents’ passing rates in English composition increased by 14.18 
percentage points, which is 7.89 percentage points higher than 
the increase for White students. Further, Black students 


experienced gains that were 3.27 percentage points higher than 
White students in intermediate algebra. We note that in terms of 
gateway math, the base gain for Black students (4.79 percentage 
points) appears smaller than that for White students (4.97 
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Table 10 
Predicted Probabilities and Marginal Effects for 1st-Year Cohort-Based Passing Rates for Introductory 
College-Level Courses, by Race/Ethnicity 


English Composition 


2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 33.36% 47.54% 14.18*** 
Hispanic 46.44% 56.56% 10.12*** 
White 49.76% 56.05% 6.29*** 
Marginal effects 
Black vs. White 7.89*** 
Hispanic vs. White 3.83*** 
Intermediate Algebra 
2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 13.78% 22.52% 8.74*** 
Hispanic 20.44% 28.05% 7.61*** 
White 18.73% 24.20% 5.47*** 
Marginal effects 
Black vs. White 3.27°** 
Hispanic vs. White 2.14" 
Gateway Math 
2011-2013 2014-2016 Diff. 
Predicted probabilities 
Black 6.97% 11.76% 4.79"** 
Hispanic 14.45% 20.76% 6.31°** 
White 16.20% 21.17% 4.97*** 
Marginal effects 
Black vs. White 0.18 
Hispanic vs. White 1.34" 


Note. Significance reported for differences prereform/postreform. 
9 < 001. 


percentage points); however, we note that the marginal effect 
gauging the difference between these changes is not statistically 
significant. Put differently, White and Black students appear to 
have experienced similar prereform to postreform gains in terms 
of 1st-year, cohort-based passing rates for gateway math. 


Discussion and Conclusion 


Florida’s DE reform sought to provide learning opportunities 
more tailored to students’ needs by doing away with traditional 
placement models and making DE optional for many students 
while revamping the way DE courses are taught and enhancing 
advising and student support services to help students make 
good choices and continue on a path for success. The result is 
that many more incoming students are taking and passing intro- 
ductory college-level courses in their 1st year of study, and pre- 
existing achievement gaps in these courses for Black and Hispanic 
students narrowed. We argue that these outcomes are a result of 
the three components of the reform working in tandem and 
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that, although not all students were directly affected by each 
component, all three are essential to achieve increased student 
momentum. 

Making DE optional (the first component of the reform) 
resulted in a significant enrollment effect—many more students 
enrolled in introductory college-level English and math courses 
when DE was no longer required. Two groups of students were 
now directly enrolling in college-level courses: those who would 
have been able to do so previously based on the traditional place- 
ment model in effect and those who would have previously been 
required to first take DE courses. Thus, not only did enrollments 
increase, but introductory college-level classrooms also become 
increasingly heterogeneous in terms of student academic ability, 
since students could enroll directly in these courses regardless of 
prior academic preparation. Although there could have been 
unintended negative consequences given the curricular and 
pedagogical challenges associated with educating a more aca- 
demically diverse group of students, we instead observed an 
overall increase in the total number of incoming students taking 


and passing introductory college-level courses once the reform 
was implemented. 

This suggests that at least some of the students who would 
have previously been required to take DE under the previous 
placement model were indeed successful in passing the college- 
level course without first taking DE. This is not entirely surpris- 
ing given that previous studies have demonstrated that 
traditional placement models often falsely assign students to 
DE courses when they would have been capable of passing the 
college-level course without first taking DE (Leeds & Mokher, 
2020; Scott-Clayton et al., 2014). Thus, one sensible policy 
lever available to states seeking to increase student momentum 
is to do away with traditional placement models and make DE 
optional. However, Florida’s policy did more than this, and we 
stress caution in adopting any DE reform that fails to address 
the needs of a third group of students: those who may still ben- 
efit from DE courses. 

Florida’s reform also contained two other major components: 
new instructional strategies for DE courses and enhanced advis- 
ing and student support services. Importantly, we note that 
Florida’s comprehensive DE reform was intended to support stu- 
dents at all levels of preparation—those on the margins of col- 
lege readiness who could directly enroll in gateway courses, as 
well as those further behind who could still take DE courses 
designed in new ways to help them progress more quickly to 
college-level courses. Thus, the new instructional strategies for 
DE courses are an important mechanism for increasing academic 
momentum for those students still required to take DE and 
those who elect to take the courses even though they are optional. 
Guiding much of this process is the other important mechanism 
by which students received benefits from the reform: enhanced 
advising and student support services. The reform also put addi- 
tional advising supports into place to help ensure that students 
made good choices. We argue that adding these two additional 
components (new instructional strategies for DE courses and 
enhanced advising) made for a more sensible reform choice than 
just eliminating DE completely, which could have harmed the 
least-prepared students. 

Although we argue that Florida’s reform functions as an inter- 
connected set of three reform measures, and although we note 
that it may not be entirely possible to disentangle the impacts of 
specific components, we see a need for additional research that 
probes deeper into the components of the reform and how dif- 
ferent students are impacted by the reform. For instance, 
although we found that gains in college-level passing rates were 
the greatest among nonexempt students who received the new 
DE instructional strategies and the enhanced support services 
(Mokher, Park-Gaghan, et al., 2020), we have not yet identified 
which instructional strategies are the most effective. And 
although we found that students who had the lowest levels of 
high school academic preparation tend to have the greatest gains 
in college-level course passing rates (Park-Gaghan et al., 2019), 
we have not yet studied the long-term educational trajectories of 
students who take, but do not pass, college-level courses. Future 
research is certainly warranted on Florida’s DE reform, particu- 
larly in looking at more distal outcomes, such as transfer and 
degree completion, particularly given that prior research has 
indicated that many DE reform efforts have had limited impacts 


on longer-term student outcomes (Jaggars & Bickerstaff, 2018). 
Finally, although not a direct focus of the legislation, another 
positive externality that warrants further investigation is the 
closing of the preexisting racial/ethnic achievement gap in intro- 
ductory college-level course completion. Future research is cer- 
tainly warranted that examines equity in other academic 
outcomes, particularly those more distal. 

Taken collectively, the findings from this investigation sug- 
gest that DE reform can have a real and significant effect on 
increasing the academic momentum in introductory college- 
level courses, particularly for traditionally underrepresented 
groups. Although we do not yet know the long-term impacts of 
the reform, we are encouraged to see that the share of students 
completing introductory-level math and English courses contin- 
ues to remain at all-time highs, even 3 years after the initial 
implementation of the policy. We encourage other states and 
contexts to consider the DE reform measures implemented in 
Florida 
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'A visual inspection of the data suggested that certain student out- 
comes were on a slight upward linear trajectory prior to the implemen- 
tation of the policy. As robustness tests, we also included squared, cubic, 
and exponential trend variables; the selection of the trend variable did 
not affect the results in any meaningful way. 
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